Videophone system for scrutiny monitoring with computer control

ABSTRACT

In conjunction with the dial-up public telephone system, voice quality lines carry videophone signals for monitoring a multitude of locations from at least one central station for use in a variety of applications, such as for security, surveillance, quality control and inspection, regulation of food and/or other standards in food-related and other facilities, market research, remote monitoring of deposit and withdrawal of funds at bank vaults, grocery chains, convenience stores, and the like. At the central station, telephonic interface apparatus is actuated by a control unit to selectively accomplish a telephonic connection with a remote location. Displays include the scene at the remote location and related graphic data. During routine operation, remote locations are displayed in sequence to at least one operator. Such operation may be interrupted either from a remote location or central station in the event of an urgency. In such an event, the concerned scrutiny location is displayed for further communication involving status, camera selection, camera configuration, audio, video and so on. Incoming calls from scrutiny stations imply an urgent situation for immediate display. The called number, by dialed number identification system (DNIS) may indicate the status while the calling number identifies the location by automatic number identification (ANI) signals. Alternative signaling and code techniques afford flexible operation as with respect to various graphic and status indications available for displays.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of application Ser. No.11/205,250, entitled “VIDEOPHONE SYSTEM FOR SCRUTINY MONITORING WITHCOMPUTER CONTROL,” filed Aug. 16, 2005, now allowed, which is acontinuation application of application Ser. No. 08/407,064, entitled“VIDEOPHONE SYSTEM FOR SCRUTINY MONITORING WITH COMPUTER CONTROL,” filedon Mar. 20, 1995, now U.S. Pat. No. 7,019,770, which is a continuationapplication of application Ser. No. 08/067,783, entitled “VIDEOPHONESYSTEM FOR SCRUTINY MONITORING WITH COMPUTER CONTROL,” filed on May 25,1993, now abandoned, which is a continuation-in-part application ofapplication Ser. No. 08/031,235, entitled “VIDEOPHONE SYSTEM FORSCRUTINY MONITORING WITH COMPUTER CONTROL,” filed on Mar. 12, 1993, nowU.S. Pat. No. 5,412,708. The subject matter in all the above-identifiedco-pending and commonly owned applications is incorporated herein byreference.

FIELD OF THE INVENTION

The present invention relates generally to scrutiny systems and moreparticularly to a videophone system for monitoring remote locations froma central unit for use in a variety of applications, such as forsecurity, surveillance, quality control and inspection, regulation offood and/or other standards in food-related and other facilities, marketresearch, remote monitoring of deposit and withdrawal of funds at bankvaults, grocery chains, convenience stores, and the like.

BACKGROUND OF THE INVENTION

Over the years, a multitude of security and surveillance systems havebeen proposed for monitoring various locations for different reasons.For example, it is particularly desirable to monitor locations involvingsome exposure to risk or peril. Generally, the objectives have includeddiscouraging an intruder, notifying security personnel, as police, andproviding some form of record of any criminal or culpable activity.

Various forms of photographic devices have been proposed for use insecurity systems; however, the advent of television substantiallyenhanced the possibilities for scrutiny or surveillance of a location.In that regard, large modern office buildings are seldom without aninternal closed-circuit system with a guard station displaying severalsignificant locations within the building. Accordingly, a single guardcan monitor a sizeable building, summoning help to a problem location.Furthermore, it has been proposed to record television monitor displaysfor subsequent study and analysis in the event of a crisis.

While previous monitoring systems have been effective, particularly inconjunction with a single facility, there have been attendantlimitations. For example, simple television displays often do notclearly manifest a potential or existing problem. Also, such systems arenot susceptible to programmed operation at a remote central processor,enabling an expert to flexibly and remotely monitor a sizeable number ofindividual locations. Furthermore, in accordance herewith, the presentinvention recognizes the need to expand the capability of monitoring toaccommodate security locations over a widely distributed area. As afurther consideration, needs also are recognized for increasedcommunication capability, enhanced displays and expanded control of thedisplays.

Surveillance of facilities for reasons other then security traditionallyinvolve substantial human involvement. For example, routine inspectionof facilities to control quality, regulate and maintain food and/orother standards at franchise and/or company-owned locations (e.g. fastfood facilities) or the like, traditionally have required personalvisits to such facilities by inspectors employed for such purposes.Unfortunately, more time and expense is incurred in traveling to andfrom different facilities than is desirable. Moreover, as a practicalmatter, specific inspectors and/or branch managers are assigned tospecific areas, resulting in a need for more inspectors dedicated toinspecting limited areas. The present invention recognizes the need toperform inspections as for controlling quality, etc. at remote locationsover a widely distributed area from a central location.

Likewise, the present invention recognizes the need for remotemonitoring of deposit and/or withdrawal of funds or executing othertransactions at bank vaults, grocery chains or convenience stores, andthe like, to deter foulplay and/or prevent burglaries. In addition, theneed for conducting discrete or interactive market research is alsorecognized.

SUMMARY OF THE INVENTION

Generally, the system of the present invention involves monitoring andcommunicating with a plurality of remote, widely distributed locations,from a central unit utilizing dial-up telephone facilities in today'scomputer environment with voice quality lines under computer control.Specifically, the dynamic graphics of telephonic video along with audiocapabilities are combined with the interactive capability of computersto attain an effective scrutiny or surveillance system. The system ofthe present invention contemplates use for applications ranging from,prevention of armed robberies and burglaries to quality control andregulation, as of food and sanitation standards, as in food relatedfacilities and the like, discrete or interactive monitoring for marketresearch, monitoring of deposit and withdrawal of funds, as at bankvaults, grocery chains and convenience stores, and so on.

In the disclosed embodiment of the present invention, videophone camerasand speakerphones or regular telephone instruments (for one-way ortwo-way communication) are placed at remote locations to communicatewith a central system that may include several communication and controlstations. A video scene display (depicting motion and color) may beprovided with graphics, audio and data signals at each communication andcontrol station. The control station may utilize well known imageenhancement techniques to allow high resolution images for closerobservation.

In one exemplary operating format, identification designations forscrutiny locations are provided in sequence to address a memory forfetching telephone numbers and/or graphic display data. Accordingly, insequence, scrutiny locations are dialed up via the public telephonesystem to obtain audio-video communication providing an image of thelocation scene. Additionally, data associated with the location isgraphically displayed for convenient reference. For example, it shouldbe noted that for security applications, response time (e.g., to callthe police) is often critical, thus having and displaying the data inconjunction with the video allows for action to be taken immediately ifrequired, either automatically or manually. Note also that the displayalso may include, the location and graphical data indicative of thefloor plan of the premise scrutinized, for example the physical locationof entry/exit points and the corresponding streets providedsimultaneously with the video scene images.

The sequence of displays may be random or predetermined, as programmedalong with intervals of display. For example, a remote location underscrutiny might be observed for thirty seconds once every ten minutes.Alternatively, at a single remote location, varying in observation timesfor different cameras installed may be programmed. For example, whenviewing a bank having a plurality of cameras, the view from a firstcamera might be taken for twenty seconds, followed by a view from asecond camera for ten seconds, then zooming onto a vault that wouldappear in the view from a third camera for ten seconds.

For each scene display, a graphic display of pertinent data is provided,for example, indicating the telephone number, the location name, e.g. abank, market or inspection site, the address of the location, thetelephone number of the police station serving the location for securityapplications, key personnel at the location and so on. When monitoringbanks and other types of locations susceptible to robbery, the status ornature of the situation, e.g., an “emergency” or “alert”, also may bedisplayed. A detector for detecting situations when a camera isinoperative, as where the lens is covered to prevent observation, may beused to convey another “alert” situation.

On command, either from a scrutiny location or the central station, acommunication may be commanded to indicate a situation. Special controlsmay be instituted enabling manifestations at the scrutiny location toinitiate action or alter the display. Special operations also may becommanded through a videophone, either on manual initiative orautomatically by sensor apparatus.

A video recorder and/or printer may be located at a remote location orcentral unit for selectively or continuously obtaining a video recordingor computer printout of displays.

Multiple control units may be employed to monitor widely distributedlocations with capabilities to route calls to each other in the eventall the communication lines are occupied and there is a considerablebacklog of calls may also be prioritized.

At each control unit, multiple operators at single monitors may beutilized, with calls sequenced to each operator depending upon thecumulative handling capability of each operator. For example, if aparticular operator is handling calls at the average rate of six secondseach, calls to that operator will be sequenced at that rate.Alternatively, a single operator viewing a single monitor or multiplemonitors is also contemplated. Furthermore, selective distribution ofcalls may be appropriate, for example calls reporting on “emergency”situations may be forwarded to a particular operator trained inemergency procedures. Alternatively, calls may be routed to the nextavailable operator. In addition, as the calls are queued in sequence,calls reporting “emergency” or “alert” situations may precede otherrouting calls in accordance with an override feature.

BRIEF DESCRIPTION OF THE DRAWINGS

A complete understanding of the invention and its advantages may begained from a consideration of the following description of somedisclosed embodiments taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a high-level block diagram of one embodiment of the system inaccordance with the present invention;

FIG. 2 is a fragmentary diagrammatic plan view of a scrutiny locationillustrating sensor and camera locations for an exemplary installation;

FIG. 3 is a more detailed block diagram of basic components in anexemplary system of the present invention;

FIG. 4 is a graphic representation of a display of the system of FIG. 3;

FIG. 5 is a graphic representation of a portion of the control panel ofan element in the system of FIG. 3;

FIG. 6 is a somewhat detailed block diagram of the central stationportion of the disclosed system in accordance with the presentinvention;

FIG. 7 is a logic diagram illustrating the operation program of thesystem of FIG. 6;

FIG. 8 is a detailed block diagram of a portion of the disclosed systemin accordance with the present invention at a remote location;

FIG. 9 is a somewhat detailed block diagram of the central stationportion of the disclosed system in accordance with an alternativeembodiment of the present invention;

FIG. 10 is a logic diagram illustrating the operation program of thesystem of FIG. 9; and

FIG. 11 is a fragmentary diagrammatic representation of a storage cellas may be formatted in the system of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENT

As indicated above, a significant aspect of the system of the presentinvention is based on recognizing that a dial-up public telephone systemmay be effectively utilized for scrutiny communication between aplurality of remote scrutiny or surveillance locations and a centralstation. More specifically, it has been recognized that for an effectivesecurity or surveillance system, dial-up voice quality lines, such asstandard analog lines, may be employed in conjunction with videophoneequipment, computer facilities, sensing apparatus and various forms oftelephonic equipment as voice generators, auto dialers and D-channel orin-band signaling apparatus for example. In that regard, a dial-uppublic telephone system TS is illustrated in FIG. 1 (upper central)affording effective communication between a plurality of remotelocations L1-Ln and at least one central unit CU.

The remote locations L1-Ln may involve a wide variety of scrutiny orsurveillance locations, for example, markets such as grocery chains andconvenience stores, banks, warehouses, residences, automatic tellers,restaurants, factories, plants, businesses, parking structures and soon. Essentially, each location L1-Ln is equipped with at least onevideophone capability (described below) to provide telephonic signalsthrough the telephone system TS to accomplish a display at the centralunit CU. Along with video signal display, under manual or computercontrol, audio and data signals are employed to supplement and enhancemonitoring operations. In that regard, each of the locations L1-Ln mayincorporate several video speakerphones (with one-way and two-waycommunication and echo canceling), cameras, sensors, switches, automaticdialing devices and computer memory capability for initiating andresponding to commands from the central unit CU, as well as, initiatingvarious actions to accomplish change or to accommodate specialcircumstances.

The central unit CU incorporates a telephonic interface, control andsequence-switching computer 12 coupled to a plurality of videophonemonitor stations V1-Vn. Accordingly, in one format, during routineoperation, the videophone stations V1-Vn simply provide a sequence ofcombined audio, scene and graphic displays revealing situations atidentified remote locations L1-Ln. In the event of special circumstancesmanifesting an “alert” or “emergency” situation, for example, one ormore of the videophone stations V1-Vn then is initially dedicated tomonitoring and communicating with one or more of the locations L1-Lnexperiencing a special situation.

The videophone terminals may be supplemented, as for an emergency.Specifically, cellular telephone capability may be provided forindependent communication. As indicated below, such capability also maybe important at locations L1-Ln.

As suggested above, a special situation, (e.g., “emergency” or “alert”)is initiated either from the central unit CU or any one of the remotelocations L1-Ln. Essentially, in response to a location-sensed specialsituation, dial-up operations are initiated to accomplish a “specialsituation” connection from one or more of the videophone stations V1-Vnso as to monitor and potentially affect the situation at one of thescrutiny locations L1-Ln.

As another consideration, police involvement may be commanded bycommunication from the computer 12 to a police facility 14 which may inturn afford communication with various police capabilities includingmobile units and emergency teams. Alternatively or additionally, undercertain conditions, a call is automatically placed to the policefacility 14 giving a message in the form of an alarm with data.Specifically for example, under predefined conditions, the controlcomputer 12 actuates an autodialer to dial up the police facility on aspecific line. For example, an operator at a terminal might wear anearphone that is coupled to the police call line. Accordingly, onviewing the display, the operator would immediately be in contact withthe police and could describe the situation. Note that the involvementof the central unit CU with police alarms can be very effective inrelation to both false and true alarms. For example, the police facility14 might be notified: “no perpetrator is visible but the ‘emergency’door is open, we are monitoring.”

Furthermore, the central unit CU may automatically place an emergencycall (for example, to indicate armed robbery in progress) to theappropriate police department, determined by a database associated withthe particular one of the locations L1-Ln at which the incident isoccurring, for example by using ANI as described below. In the interim,the operator may describe the situation to the dispatcher at the policedepartment or may be connected directly to the responding patrol car.Alternatively, the operator may actuate an autodialer, such that theautodialer code number (obtained from the central unit database)displayed on the operator's video terminal connects him or her to theappropriate police department. In the event there are complications, theoperator may use a regular telephone or a cellular telephone andmanually dial the telephone number displayed on the video terminal.

Preliminarily, considering an exemplary sequence of operations withreference to FIG. 1, assume that the location L1, a bank, is entered bya person carrying a gun with an intent to commit robbery. At some point,as described in detail below, the intention of the person may becomeknown and manifest by a command signal, variously generated at thelocation L1. As a result, telephone equipment at the location L1 isactuated, prompting dial-up operations to accomplish a connection fromthe bank location L1 through the telephone system TS and the computer 12to one of the videophone stations V1-Vn. Assume for example that thevideophone station V1 is involved. As described in detail below, in sucha situation, the called number to the computer 12 (originated by thelocation L1) indicates the nature of the special situation, e.g.,“emergency” or “alert”. That is, the nature of the situation isindicated by dialed number identification signals (DNIS) using acapability readily available from the telephone system TS, as forexample on the so-called D-channel. The dialed number identificationsignals (DNIS) may likewise indicate the type of location where thespecial situation is occurring, for example, where certain monitors atthe central unit CU are dedicated only to supermarkets and others onlyto banks or the like.

It is to be noted that while the D-channel provides one operationalconfiguration, some DNIS and/or ANI (Automatic Number Identification)data signals can be received in-band without D-channel apparatus. In anyevent, DNIS signals indicate the called number from the bank locationL1. With the provided data (e.g. using DNIS for situation, ANI foridentification) the computer 12 fetches identification data for agraphic display at the videophone station V1. Thus, the videophonestation V1 displays a video scene within the bank location L1 along withgraphic data, for example, to indicate: the nature of the specialsituation, e.g. “alert” or “emergency”, the location, key personnel andso on. Of course, image enhancing techniques, as associated with currentvideophone technology for enlarging the signals received at the centralunit CU or to provide higher resolution pictures may be utilized.Accordingly, large monitors may be utilized at the central station forviewing such enhanced images.

Alternately, personnel at the remote location under scrutiny may call apredetermined telephone number for the central unit CU, whereby asdisclosed below, the use of ARU (FIG. 9) interactive technologyincluding voice generators can prompt entry by TOUCH TONE® (DTMF padentry) of remote location code number or predetermined situation codes(with DNIS). For example, personnel from the remote location may begiven by voice prompts, either live or prerecorded, for example, “Pleaseenter your remote location code followed by the situation code, 1 foremergency or 2 for alert.”

By using dedicated communication lines to remote locations L1-Ln,telephones at the remote locations may be configured to answer after apredetermined number of rings, e.g., three rings. Thus, regular pollingof the remote locations L1-Ln at selected or random times during the daydetermines if the line is operational. In the event the line is busy orout of order, an “alert” situation may be communicated to the centralunit CU whereby the police may be summoned to investigate the situationat that particular location Ln. Alternately, to save telephone expensesand avoid billing, the central unit CU may initiate a call to determineif a line is operative, but, terminate the call upon making thedetermination during the initial stage that the situation is normal. Forexample, the system may terminate a call after two rings rather thanwait from an answer at three rings. Also, detectors located at theremote locations L1-Ln could indicate an “alert” situation to thecentral unit CU, for example, in the event a lens has been deliberatelycovered to prevent scrutiny. Alternatively, remote locations may providedistinctive or unique audio tones recognized by the central units CU inthe event fraudulent replacement of telephones or the like to simulate anormal situation is contemplated by offenders.

As another feature, an incoming line can be designated at the centralunit CU, as an 800 line to receive calls from any telephone to promptscrutiny. For example, a call on the line may be answered by aninterface or an operator to be notified to establish scrutiny at aspecified location. In that regard, the location might be specified byANI signals. Accordingly, a person at a security location who becomesaware of a potential danger can simply call the designated number fromany telephone to instigate scrutiny.

At the central unit CU, the emergency display continues with the systemimplementing manual controls as disclosed in detail below. For example,the status of the situation can be altered, various cameras at thelocation L1 may be selected, scenes may be modified and audio or videomay be controlled. Note that the cameras may be of various kinds, forexample, wireless, panning, zoom and so on. Also, the cameras may beoperated to modify scenes by panning, zooming, tilting or providingfreeze frames, as desired. Furthermore, a record (VCR) may be made ofall received signals as for subsequent study. Note also that byassigning each of the locations L1-Ln, a distinct DNIS (called number)identification data in the memory can be accessed accurately by the DNISnumber if desired.

Recapitulating to some extent, at the central unit CU, multipleoperators at single monitors may be utilized, with calls sequenced toeach operator depending upon the cumulative handling capability of eachoperator. For example, if a particular operator is handling calls at theaverage rate of six seconds each, calls to that operator will besequenced at that rate. Furthermore, selective distribution of calls maybe appropriate, for example calls reporting “emergency” situations maybe forwarded to a particular operator trained in emergency procedures.Alternatively, calls may be routed to the next available operator. Inaddition, as the calls are queued in sequence, calls reporting“emergency” or “alert” situations may precede other routing calls inaccordance with an override feature.

To consider the operation of the embodiment in somewhat greater detail,reference will now be made to FIG. 2 generally showing a plan view of aportion of an illustrative bank location. It should be recognized thatvarious other arrangements of cameras may be installed at supermarkets,parking structures, quality control facilities and the like.

FIG. 2 illustrates a layout of video cameras along with sensors andswitches that may be employed to indicate situations in the bank. Theindividual cameras, switches and sensors (including manual switches) maytake a multitude of forms. For example, the sensors might be sonic,infrared, visible light, metal detectors, and so on.

As another consideration with respect to an individual location orfacility, as described in detail below, the active sensors and camerasmay be modified manually or in accordance with an operating schedule forthe location. For example, when a bank is closed, it may be prudent toeliminate cashier window monitoring and concentrate on access points. Ina related context, a location might be selectively monitored, e.g.,access points only, when the installation is “armed”, as when alarms areset. When the installation is “armed”, a message is conveyed to thecentral unit CU to commence specific monitoring. Alternately, a locationmay be monitored at specific preprogrammed times, controlled by a clock.For example, a select bank may be monitored between 10:00 am and 4:00pm. Additionally, at that bank location, varying observation times fordifferent cameras may be programmed. For example, the view from onecamera might be taken for twenty seconds, followed by a view fromanother camera for ten seconds, then zooming onto a vault that wouldappear for ten seconds.

In the context of an ATM site, motion detectors may be utilized todetect approaching individuals, whereby the motion detector upondetecting an individual initiates contact with the central unit CU forviewing. Alternately, entry of a PIN (personal identification number) byan ATM customer may likewise initiate contact. It is also contemplatedthat initiating contact with the central unit CU could be controlled bythe clock, such that the central unit CU may be configured only toreceive calls at select intervals of time, for example between 7 p.m.and 12 a.m. Additionally, the system may be configured such that DNISand ANI communication features cross reference with the clock prior toanswering. For example, if the present time is between 5 p.m. and 10p.m., select calls are not accepted.

Considering FIG. 2 in greater detail, four teller windows T1-T4 areillustrated (right) in a room 16 adjacent a desk area 15 indicated to bepartially enclosed. At the other side of the room 16, an entrance 18 isrepresented. Thus, in a somewhat simplified traditional arrangement,bank customers enter the room 16 through the entrance 18 to transactbusiness either at one of the teller windows T1-T4 or in the area 15.

Of course, the extent of coverage and the position of cameras isexpected to vary widely in different installations. However, in theexemplary arrangement of FIG. 1, a camera C1 provides a wide-angle viewof the transaction area. A camera C2 covers the area 15 and cameras C3,C4, C5 and C6 are concentrated respectively on the teller windows T1,T2, T3 and T4. The cameras C1-C6 are adjustable and as a consequence mayzoom, pan, tilt and freeze frame with reference to a subject. Thus,considerable flexibility is afforded in monitoring the room 16. Notethat cellular telephone techniques may be employed in relation to thelocations L1-Ln, as for example, the camera C1 might be backed up by acellular phone arrangement to function in the event of a telephone lineseverance. Battery backup, of course, is contemplated.

Various forms of actuators or sensors may be provided to indicate aspecial or urgent situation at the bank. For example, as illustrated inFIG. 2, manual silent alarm switches S1-S4 are provided at a convenientlocation for each of the teller windows T1-T4 respectively. Typically,the switches S1-S4 would be positioned to enable subtle actuation. InFIG. 2, the switches S1-S4 are labeled “R” (red) to indicate an“emergency” situation on actuation. That is, if a teller actuates one ofthe manual switches, a realistic possibility exists that the teller isbeing held up and a “red” or “emergency” situation is indicated.

The area 15 containing a desk 20 is provided with three manual switches,S5, S6 and S7, each to manifest a situation of a different type.Specifically, the switch S5 indicates an “emergency” or “red” situation,the switch S6 indicates an “alert” or “yellow” situation and the switchS7 indicates a “routine” or “green” situation.

The desk 20 also is equipped with a telephone instrument represented byan encircled letter “T” and designated “21”. The telephone 21 is coupledinto the system and may be employed to interface the central unit CU(FIG. 1) as described below.

In addition to manual switches, automatic sensors are represented inFIG. 2. Specifically, a switch S8 comprises an infrared sensor fordetecting motion. Of course, various forms of sensors and variousoperating philosophies may be implemented. For example, in thearrangement of FIG. 2, the absence of motion (routine business) withinthe room 16 actuates the sensor switch 18 to indicate an alertsituation. Alternatively, motion in certain areas, at certain times mayindicate an emergency.

Switch S9 is embodied as a doorway metal detector. Accordingly, passagethrough the entrance 18 by a person bearing a weapon actuates the switchS9 to command an “alert” or “yellow” situation. As indicated, commandingany situation actuates the system to establish communication from thebank location L1 to the central unit CU to initiate monitoring,recording and selective involvement.

To consider the system of the disclosed embodiment in somewhat greaterdetail, reference now will be made to FIG. 3 in which previouslyidentified components bear similar reference numbers. Accordingly, thedial-up telephone system (center) is designated TS, scrutiny locations(right) are designated L1-Ln and a plurality of central units CU1-CUNare connected through a central unit switch CUS. Generally, the switchCUS may implement various control formats to selectively allocatecommunications between the central units CU1-CUN.

In accordance with one exemplary system, the multiple central unitsCU1-CUN may be employed to monitor widely distributed locations withcapabilities of routing calls to each other. Also, each of the centralunits CU1-CUN, multiple operator may be used such that calls aresequenced to each operator depending upon the cumulative handlingcapability of each operator.

Recapitulating to some extent, the dial-up telephone system TSaccomplishes communication through the switch CUS between a selectcentral unit CU1-CUN end the individual scrutiny locations L1-Ln. Thecommunication may be initiated either by the central unit CU1 or any oneof the scrutiny locations L1-Ln. Assume connection to the central unitCU1. Typically, during intervals of routine operation, the central unitCU1 initiates contact with the scrutiny locations L1-Ln in sequence(either predetermined, such as when scheduled, or randomly, such as ondemand or randomly scheduled) to afford momentary viewing of scrutinylocations. However, it should be noted that continuing scrutiny, i.e.,clocked scrutiny for an entire eight hour shift also is likely forcertain various high risk locations.

Upon the occurrence of a condition at one of the scrutiny locationsL1-Ln suggesting or indicating a special situation, or merely as acheck, a command signal may be initiated either manually orautomatically to accomplish the communication. Such a command signalindicates either a “routine” situation (green), an “alert” situation(yellow) or an “emergency” situation (red).

Only one of the scrutiny location structures L1-Ln is disclosed indetail in FIG. 3. Specifically, in the scrutiny location L1, at leastone television unit 26 is provided for producing a television signalrepresenting both video and audio. That is, as illustrated in FIG. 2,several separate television units may be provided to cover differentareas of a scrutiny location or provide different aspects. Each unit 26includes the elements of a videophone, e.g. camera, display,speakerphone, etc., along with control capability as disclosed below.Audio and video signals from the television unit 26 (along with anyduplicate units) are provided to a telephone interface control unit 28incorporating a videophone encoder-decoder (CODEC) chip set, a telephoneswitch and a control computer. A form of the interface unit 28 istreated in detail below. However, the unit has the capability toaccommodate videophone operation along with telephone switching and avariety of control functions.

The interface unit 28 also is connected to several operating devicesincluding an auto dialer 30, a memory 32 and status controls 34. Thesestructures are disclosed in somewhat greater detail below; however, theauto dialer 30 may take any well known form of such units as may thememory 32. The status controls 34 may take a multitude of differentforms as considered to some extent with reference to FIG. 2. That is,the status controls 34 may include manual switches, photoelectricsensors, infrared sensors, visible light sensors, metal detectors andeven threshold sonic detectors. For example, a sonic detector mightsignal a gunshot to command an emergency status.

The interface unit 28 is also connected to a video recorder (VCR) 35,which may be set to record continuously or intermittently to providehistorical data for fraud prevention or the like. On receiving a requestcommand, for example from the central unit CU1 (shown in detail), thevideo recorder 35 may transmit compressed video signals of the recordingto the central unit CU1. Alternatively, employees at the remote scrutinylocation L1 may initiate transmission of compressed video signals whenindicating an emergency situation. Of course, continuous recording bythe video recorder 35 may be suspended when the central unit CU1initiates contact with the scrutiny location L1 and during momentaryviewing thereof. In the event, the scrutiny location L1 is at an ATMsite where each transaction is typically recorded, such video recordingsor portions thereof may be transmitted to the central unit CU1 uponreceiving a command therefrom.

At locations where multiple cameras are positioned, a single videorecorder 35 may be connected to the multiple cameras via a switchingdevice (though shown as part of the video recorder 35, may be separatetherefrom) to control and sequence the recordings from the cameras. Aswitching device such as the intelligent sequential switchermanufactured by SONY, under Model No. YS-S100 may be used to control andsequence multiple recordings.

Alternatively, in some situations where a video recorder 35 is connectedat the central unit CU1, select frozen frames of viewings or a specifictime period of each momentary viewing can be recorded, for example twoseconds (specific time period) of the twenty seconds (momentary viewing)for each remote location.

Likewise, the interface unit may be connected to a printer 37 forproviding a printed record of each predetermined or random momentaryviewing, indicating the date, time, location, period of monitoring, etc.Thus, a detailed hard-copy record is developed.

To consider an exemplary operation sequence within the location L1, uponthe actuation of one of the status controls 34 (special situationsignal), the unit 28 fetches two distinct telephone numbers, i.e., acalled number and a calling number. The called number comprises one ofthe numbers for establishing communication with the central unit CU. Ofseveral such numbers, each indicates an individual status. For example,called numbers for the central unit CU might be assigned as indicated bythe following chart:

CHART 1 Remote Location Calls Called No. Status Time 555-1111 Routine(G) Preset 555-2222 Alert (Y) Hold-Manual Control 555-3333 Emergency (R)Hold-Manual Control

Thus, the unit 28, by selecting a calling number for the central unitCU1, indicates status at the central unit. Accordingly, if a statuscontrol 34 at the scrutiny location L1 detects an emergency situation,the unit 28 commands the memory 32 (look-up table) to provide atelephone number “555-3333” for actuating the auto dialer 30 to producedial signals (through unit 28) to the dial-up telephone system TS.Accordingly, connection is established with the central unit CUindicating an “emergency” status, i.e. “condition red”. The “emergency”signal would be indicated at the central unit CU by Dialed NumberIdentification Signals (DNIS) utilizing facilities readily available andprovided by the dial-up telephone system TS through the so-calledD-channel or in-band signaling apparatus.

The dial-up telephone system TS also provides Automatic NumberIdentification (ANI) signals indicating the calling number on theso-called D-channel or in-band signaling apparatus. In the disclosedembodiment, such signals identify the location of the remote scrutinystation L1 to the central unit CU1. Note, that the memory 32 may providealternate forms of calling signals commanding a specific outgoing linefrom the telephone interface and control unit 28 to afford additionalcommunication. For example, ANI signals alternately might command eitherstatus, other situations or related data.

Upon attaining communication with the central unit CU1, the remotescrutiny location L1 is in videophone communication with the centralunit CU1. Specifically, the television unit 26 provides videophonesignals through the unit 28 and the dial-up telephone system TS to thecentral unit CU1 to manifest the current circumstances in the form of ascene and graphics and in some cases audio signals.

Summarizing to some extent, upon the actuation of a command signal at ascrutiny location, e.g. scrutiny location L1, a connection isestablished from the scrutiny location L1 to the central unit CU1through the telephone system TS. Additionally, signals are provided (ANIand DNIS) at the central unit CU1 to indicate the specificidentification of the scrutiny location L1 and the status affording thebasis for the call.

As another aspect hereof, the system may test conditions at a locationprior to, or as part of providing a display. Human involvement mayaccordingly be reduced. For example a video picture can be digitized andrecorded to provide a video recording that indicates a scene at aspecific instance of time. If that scene does not change, to someextent, the assumption is that it is secure. Accordingly, after the timeof recording the scene, another video picture is provided, digitized andcompared with the first picture. Unless the change amounts to apredetermined percentage or part of the total picture, the location isassumed to be secure. As an example, a closed vault door may be thesubject of the picture. If it is opened on a subsequent check toindicate a substantial change in the picture, an emergency is indicatedand the system should be activated to provide a display. Additionally,depending upon monitoring periods, if a video picture is compared with aprevious one, for example after ten minutes, and only a change of 5% isperceived, it can be safely concluded that everything is normal.Accordingly, transmission of video pictures to the central unit CU maybe suspended. Such comparator circuitry may be provided at the remotelocations L1-Ln or at the central unit CU1.

Within the exemplary central unit CU1, a telephone switch 42accommodates both incoming and outgoing traffic serving a plurality ofvideo display stations or terminals V1-Vn. Each of the terminals V1-Vnincorporates the capability of a videophone (CODEC chip set, display,camera, speakerphone, keypad, control, etc.) along with additionalcontrol functions as described below. In that regard, the displayterminals V1-Vn may incorporate relatively large monitors and a varietyof other enhanced apparatus for more effective prolonged human use.

Each of the video terminals V1-Vn are connected to a control system 44that is in turn connected to an auto dialer 46, a memory 48 and a videoaudio recorder 50 (video and audio capability). Essentially, these unitsare time shared by the video terminals V1-Vn. In that regard, capabilitymay be provided in the control system 44 to transfer connections tolocations L1-Ln as between the terminals V1-Vn. For example, in thatregard, operators at the terminals V1-Vn may be specialists for variousconditions with designated calls routed to specific terminals andtransfer capability to accommodate changes in situations.

Recapitulating, as explained above, the exemplary central unit CU1functions both to initiate outgoing calls and receive incoming calls forflexibly monitoring the remote scrutiny locations L1-Ln. To continuewith the explanation of an incoming call, when the telephone switch 42in the central unit CU1 receives an incoming call, it will be connectedto one of the video terminals V1-Vn. Concurrently, incoming data signals(DNIS and ANI) are passed to the control system 44. From the memory 48,the system 44 fetches the identification of the location L1 and thedesignated status, e.g., “emergency”, “alert”, or “routine”. With suchsignal represented data, the control system 44 may select a specific oneof the terminals, e.g. terminal V1, to handle the call. The controlsystem 44 then provides computer graphic signals to the selected videoterminal V1 supplementing the coupled television scene display.Specifically, the video terminal V1 presents a viewer with a compositedisplay of a scene at the location L1 along with appropriate graphicdata. For example, assuming the location L1 is a bank branch office, thedisplay by the terminal V1 could be somewhat as represented in FIG. 4.In that regard, the display has been simplified for purposes ofexplanation, particularly with regard to the room interior.

FIG. 4 shows the screen 60 of the terminal V1 depicting the scene insidethe bank at the location L1. In the foreground, a group of people 62 areindicated to be standing in line at a teller window 64. Other people 66are indicated to be standing near an entry door 68. As shown, note thatin the scene, the graphics also indicate the door is located on 3rdStreet. It should be noted that a graphical cursor 71 indicating N/S/E/Wis displayed. A considerable amount of other graphic informationsupplements the scene display as indicated, specifically in the form ofcontrol status data 70 and location identification data 72.

Generally, the elements of the graphic data are self-evident. However,the first line of the identification data 72 indicates a telephonenumber for the scrutiny location, the next several lines indicate thename of the facility at the location L1, the address, and key personnel.Finally, the last line of the identification data 72 indicates atelephone number for the police station serving the location L1.

Typically, upon the initiation of communication between one of thedisplay terminals V1-Vn and one of the scrutiny locations L1-Ln, theidentification data 72 is presented and remains displayed withoutchange. However, the control status data 70 (lower left) may be varied,depending on specific operating conditions as will now be considered.

As illustrated in FIG. 4, the control status data 70 reveals an “alert”status (situation “yellow”), the scene being presented by the camera C1and the outgoing audio (central unit CU to location L1) being “on”.Typically, the outgoing audio would not be active on initial contact.However, the initial conditions would be established and programmeddepending on location, schedule, etc., the program being provided by thememory 48 (FIG. 3). However, after connection, the conditions may bevaried to accommodate different situations as perceived either at theterminal V1 in the central unit CU1, or at the location L1. For example,a manager at the desk 20 (FIG. 2) may use the telephone instrument 21 tocommand a change. In a similar way, changes can be commanded from theterminal V1 as will now be considered in detail.

Recapitulating, the terminal V1 (FIG. 3) has been described to be incommunication with the location L1 to provide a display as illustratedin FIG. 4. In addition to the display, the terminals V1-Vn incorporate asubstantial control panel that my be embodied as part of a personalcomputer keyboard. Specifically, the control panel for each terminalV1-Vn includes all the current controls for a videophone, plus dedicatedcontrols relating to the disclosed system. In that regard, in theinterest of avoiding undue complications, only a fragment of therepresentative panel for the terminal V1 is shown in FIG. 5. Note thatone panel could be used or could share multiple displays.

Specifically, the fragment of the panel 80 of FIG. 5 incorporates atraditional twelve-button telephone pad 82 bearing the numerals “1”through “0” along with the symbols“*” and “#” for generating DTMFsignals in accordance with standard convention. Additionally, variousspecific controls are provided. An on-off button 84 controls outgoingaudio. A toggle 86 controls the volume of incoming audio. An on-offswitch 88 controls outgoing video. A pair of toggle switches 90 and 91respectively control zooming and panning camera operations. A pushbutton switch 93 serves to halt a sequence of displays may besimultaneously displayed from remote locations locking onto the currentdisplay (freeze frame) for closer observation to investigate suspiciousactivity or record data on a suspicious individual for closerobservation and in some cases higher resolution at a later time. Inaddition, another toggle switch 95 controls tilting camera operationsand a push button 97 advances the freeze frame for subsequentobservation. A pushbutton switch 99 serves to manually advance orrequest the next display in the sequence of displays. A control switch101 regulates the speed at which the sequence of displays are viewed.Finally, a signal lamp 103 illuminates to indicate that a video camerahas become inoperative. For example, the lens of a camera might bedeliberately covered or spray painted at the outset of a robbery. Asdisclosed below, the system should then advance to another camera withinthe remote location.

Recognizing that communications to the terminal V1 can be variouslyinitiated, the control panel 80 enables various commands. Again,recognize that communication may be established in a program sequence asdescribed in more detail below or originated at either the central unitCU or a remote location L1-Ln. Generally, by using the telephone keypad82 on the panel 80, various control functions can be accomplished asindicated by the following chart.

CHART 2 Command Name Operation 30 Status Designates a status command isto follow 31 Routine Sets “routine” status 32 Alert Sets “alert” status33 Emergency Sets “emergency” status 40 Camera Designates a cameracommand is to follow 41 Camera C1 Sets camera C1 active 42 Camera C2Sets camera C2 active 43 Camera C3 Sets camera C3 active | | | 50Synthesized Designates a synthesized voice Voice command is to follow 51Observed Actuate voice generator to announce: “You are being observed .. . ” 52 Recorded Actuates voice generator to | announce: “You are being| recorded . . . ” | # Execute Execute entered command * Clear Clearsany entered or partially entered command 11* All Clear Clears allcommands to receive fresh operating commands

To consider some examples, if the observer of the screen 60 (FIG. 4)perceives that the situation has become dangerous, touching the keypadbuttons for “3” and “0” followed by the buttons designated “3” and “3”will change the represented status to situation “red” (R), i.e.,“emergency”. Note that as indicated in the display (FIG. 4), the statussituations are indicated as a part of the status data. Also, the statusdata may be presented in three different colors, e.g. red, yellow andgreen, to indicate the situation somewhat more emphatically.

To consider another circumstance, in viewing a display on the screen 60(FIG. 4), the video may be lost or the observer at the terminal V1 (FIG.3) may wish to concentrate on a specific one of the teller windows T1-T4as represented in FIG. 2. For example, it may be desirable to actuatethe display of camera C3 (FIG. 2, upper right) directed at the tellerwindow T1. Accordingly, the keypad 82 is actuated first by touchingbuttons or keys “4” and “0” followed by the numerals “4” and “3” toactuate the camera C3. As a result, the display of the screen 60 isshifted to a view of the teller window T1.

To consider still another control operation, observation of the displayon the screen 60 (FIG. 4) may suggest that some audio communication maybe desirable from the video terminal V1 to the bank location L1.Initially, the audio “on-off” button 84 (FIG. 5) would be actuated toinitiate audio communication. In that regard, note that audiocommunication from the bank to the video terminal V1, i.e., audio “in”is usually active.

After actuating the outgoing audio to the bank location L1 (FIG. 1), theoperator at the terminal V1 may elect between speaking an audio messageor selecting a prerecorded audio message from memory and utilizing avoice generator as will be explained in greater detail below. In thatregard, some situations may be particularly tense and a desirableprocedure would involve simply indicating to those present in the banklocation L1 that the entire scene is under surveillance and a videorecord is being produced. Activating an audio record carrying themessage in a powerful and confident voice may be the prudent course ofaction. Under such circumstances, as indicated in the above chart ofcommands, the operator may simply touch the buttons “5”, “0” to commanda synthesized voice message, then touch a specific command for aparticular message. For example, the buttons of “5” and “1” command thevocalization of a message “You are being observed . . . ”.

Note that after each command is issued, the operator must touch thenumeral or pound symbol (“#”) button to execute the entered command. Toclear any entered or partially entered command, without execution, theoperator simply touches the asterisk (“*”) button. Finally, clearing theoperating commands totally involves touching the code: “1, 1, *”.

With the system in a cleared state, any of a variety of operationalcommands may be given, for example, a partial list of such commands is:

CHART 3 Command Name Operation 20 Op. Comm. Operational commands tofollow 21 Pre. Seq. Revert to sequencing a predetermined program oflocations 22 Rand. Seq. Revert to sequencing a random program oflocations 23 Set Call Dial up a select location as identified by afour-digit number to follow 24 Police Actuate police connection | | | || | | | |

As an example, touching the keypad 82 (FIG. 5) to enter “2” and “0”indicates an operational command follows. Thereafter, entering “2” and“1” prompts the system to revert to a sequencing operation as describedabove in accordance with a predetermined program schedulingcommunication and monitor displays of individual remote locations.Alternatively, entering the numerals “2” and “2” initiates another formof sequencing in which the control computer provides a random program(within limits) to randomly observe or monitor remote locations. Notethat dwell time may vary widely or be programmed for individuallocations L1-Ln.

As other operating examples, entering the numerals “2” and “3” indicatesthat the operator will next enter a four-digit number designating aparticular remote location thereby providing a memory location addressfrom which a telephone number for the location will be fetched andemployed to actuate an automatic dialer as described below. Finally, asanother example, indicated in the above chart, actuating the keypad 82(FIG. 5) to enter the numerals “2” and “4” establishes connection withthe police facility 14 (FIG. 1) thereby bringing such a facility intocommunication with the system in various arrangements.

Quality control monitoring involves rather different operations. Forexample, an inspector observing a plurality of fast food sites, such as“McDonalds”, may wish to instruct an employee, “Put on your foodhandling gloves,” by use of the on-off button 84. Alternatively, theinspector may request inspection of the facility for regulationpurposes.

Along the same lines, routine supervision of transactions, e.g. depositsand withdrawals of funds, at bank vaults, grocery chains or conveniencestores, or the like can be remotely monitored and even recorded to deterfoulplay.

Similarly, at banks, supermarkets or the like, market research can beperformed by monitoring all the transactions and observing people'sreaction to new interest rates, products, etc. The on-off audio buttonmay be used for interactive communication with customers, if desired.

From the above descriptions, it is apparent that the disclosed systemutilizes videophone technology in combination with other telephonesystem technology along with computer control and graphics technology toaccomplish effective security monitoring and, to some extent, activeinvolvement. To explain the system in greater detail, the structuralcomponents now will be considered. First, the central unit CU is treatedwith reference to FIG. 6. As mentioned above, elements previouslydescribed bear similar reference numerals. Accordingly, a plurality ofindividual monitor work stations V1-Vn for involved security monitoringare represented at the bottom of FIG. 6. As the terminals are similar,only V1 is shown in any detail. As indicated above, the terminals V1-Vnare collectively served by the other apparatus of the central unit asillustrated in FIG. 6.

To accomplish a complete understanding, the explanation of the centralunit of FIG. 6 now may best be pursued by assuming certain circumstancesand proceeding to describe the attendant operation concurrently with theintroduction of any fresh components. Accordingly, inbound callingoperations initially will be treated followed by a comprehensivetreatment of outbound calling procedures.

Initially, as described above, inbound calls are received through thetelephonic interconnection 102 (FIG. 6, upper left) accommodated by theinterface telephone switch 42 as well known in the art. The informationsignals accompanying calls (ANI and DNIS) are passed to a D-channelcircuit 104 as for decoding. That is, as indicated above, the callingnumber signals (ANI) identify the calling remote location. The callednumber signals (DNIS) indicate the state or situation prompting thecall, e.g., designations “green”, “yellow” and “red” respectivelyindicating “routine”, “alert” and “emergency” situations.

Information carried by the ANI and DNIS signals is supplied from thecircuit 104 to the memory 48 upper right through the control computer44. Specifically, a line 103 carries the situation information (DNIS)while a line 105 carries the call identification (ANI-Caller I.D.).Consider the ANI processing initially.

From the control computer 44, the representative ANI signals address thememory 48 to fetch detailed graphic information, specifically theidentification data 72 as illustrated in FIG. 4. A signal representedform of such data is supplied from the control computer 44 through oneof a series of graphic lines G1-Gn to a selected one of the monitorstations V1-Vn. Application to the station V1 will be assumed inpursuing the explanation, however, details of such selection are treatedbelow.

Within the station V1, the graphic identification signal data on acaller is received by a graphics generator 108 for processing into avideo signal that is supplied to a video mixer 110. The output from thevideo mixer 110 drives a monitor 114 to provide a scene-graphicsdisplay.

As a concurrent operation with the ANI signal processing, the DNISsignal representation also is applied by the control computer 44 to thememory 48 for fetching an indication of the location status. Signalrepresentations of the status also are supplied from the computer 44 tothe graphics generator 108 and produce a situation representation (seestatus data 70, FIG. 4). Thus, the video mixer 110 receivescomprehensive graphic signals for display concurrent with the picturescene representation, the signal source of which will now be considered.

With the completed telephonic connection from the remote location (FIG.1), as assumed above the specific incoming line is coupled to themonitor station V1. Specifically, the videophone signals are received bya videophone signal processor 112 (FIG. 6) for driving the video monitor114 incorporating the display screen 60. Specifically, the signalprocessor 112 is coupled to the video mixer 110 to provide the scenecontent of the display.

The videophone signal processor 112 incorporates a video CODEC alongwith computing capability and may take the form of an AVP1000 videoCODEC chip set as available from AT&T. Essentially, the CODEC chip setaccomplishes videophone operation and consists of a video encoder, avideo decoder and an internal system controller. As known, the systemcontroller provides and receives: video data, audio data and datasignals. In that regard, the videophone processor 112 is illustratedwith cable (multiple path) connections. That is, path or line P1 is oneof a series of lines P1-Pn carrying an encoded videophone signal betweenthe switch 42 and the processor 112. A line 113 then carries receivedvideo data to the video mixer. A line 115 (bus or cable) carries severalother signals to the monitor 114, specifically, transmitted and receivedaudio, transmitted video and data signals. The videophone processor 112also is connected to the control computer 44 for data signal flow.

In addition to the display screen 60, the monitor 114 incorporates aspeakerphone 116 and a video camera 120. As indicated above, signalsfrom the speakerphone 116 and the video camera 120 are selectivelytransmitted to the remote location through the line 115 and theprocessor 112 under manual control.

Recapitulating to some extent, on receipt of an incoming call, ANI andDNIS data is processed along with the subsequent encoded videophonesignal for application to a select monitor station to provide thepicture display (scene and graphics) as generally represented in FIG. 4.Upon such an occurrence, the manual control panel 80 (FIGS. 5 and 6)adjacent the monitor 114 may be utilized to accomplish a number ofoperations including: changing the status, selecting a particular cameraand controlling the zooming or panning of the camera, actuating eitheraudio or video manifestations at the bank location L1, effecting apolice connection, and so on. Accordingly, any of a number of coursesmay be pursued under the control of a trained operator includingsupplements to the video record as in the form of comments. As indicatedabove, for example, the operator can command a synthesized voice messageto be delivered audibly at the location L1. Specifically, voice data isdrawn from the memory 48 (audio dictionary), a message is formulated bythe central computer using well known techniques of the art and providedto a voice generator 111. The audio output from the voice generator 111is processed by the processor 112 or, as illustrated, by the telephoneinterface switch 102. In any event communication is to the location L1.

In the operation of the system embracing the exemplary formats astreated above and below, a record is made for billing purposes. That is,a billing data memory 49 (upper left, FIG. 6) and a printer 51 arecontrolled by the computer 44, recording all transactions in relation tobilling charges. Such data can be variously processed at differenttimes.

To this point, consideration has been primarily directed to thetreatment of incoming calls. Alternative modes involve the placement ofoutgoing calls under manual control and the automatic operation toprovide a sequential display from remote locations L1-Ln. Suchoperations next are treated in detail.

Consider first the functions of the system when an operator manuallyinitiates a call from the monitor station V1 to one of the remotescrutiny locations, e.g., location L1. Specifically, assume the need toestablish a connection from the monitor station V1 to the remote banklocation L1 initiated by an operator at the monitor station V1. Undersuch circumstances, the operator actuates the manual panel 80 (FIGS. 5and 6) using selected commands (chart above) as will now be considered.

At the outset, a command “11*” clears the monitor station for manualcontrol. Next, a command “20” indicates that operating commands are tofollow. The operator next touches “23” to indicate that a specificremote location number will follow. Continuing, the operator touches thefour-digit address signal for the location L1 in the memory 48. As aresult, the control computer 44 (FIG. 6) addresses the memory 48 tofetch the telephone number for the bank location L1. The telephonenumber is supplied from the memory 48 to the control computer 44 whichactuates the auto dialer 46 to provide the dial-up signals on anoff-hook line provided in the coupling 102 to the dial-up telephonesystem TS (FIG. 1). Typically, at the location L1 a dedicated line willaccept the communication.

As with all dial-up operations, certain conditions are predetermined.That is, a particular camera (and settings) is specified and a tentativestatus also is specified. Typically, unless the status is specified, thedial-up connection will provide a “routine” or “green” status indicationand utilize a camera positioned to provide a wide-angle field of view.Of course, as indicated above, the operator can immediately modify theinitial predetermined conditions utilizing the control commands asexplained above. Thus, under manual control, the establishedcommunication may be preserved for a period or terminated after a quickcheck of the situation. Manual control continues until the system againis set into an automatic sequence mode.

For most operating systems, it is likely that manual operation will notdominate the system. Rather, during much of the time, the monitorstations will collectively be programmed to automatically provide asequential display of the remote locations L1-Ln. Thus, at thetermination of an interval of one-to-one operation, a command will begiven to resume sharing in the sequence monitoring. Specifically, asindicated above, a command of “21” will actuate the system to thepredetermined program of locations or alternatively, a command “22” willactuate a random sequence operation.

During the sequential operation, the control computer 44 (FIG. 6)fetches telephone numbers for the remote locations L1-Ln from the memory48 in a sequence, actuates the auto dialer 46 accordingly, and assignsthe resulting connections to one of the monitor stations V1-Vn. Anobservation format may be implemented, however, in any event, after ashort interval of operation, e.g. 30 seconds, the control computer 44terminates the display connection to a station V1-Vn in favor of anotherwaiting connection. The operation results in a sequential display oflocations at each of the monitor stations V1-Vn.

A logic program indicating the control operations of the controlcomputer 44 will now be treated with reference to FIG. 7. The program isentered at a line 130 (upper left) shown leading to a decision or queryblock 132. The query posed by the query block 132 relates to whether ornot there is an “incoming” call. In that regard, in the sequence dial-upoperation of the system, the logic preserves a readiness for receivingincoming calls. Should there be such a call, prompting a “yes” path fromthe block 132, the process will proceed to a block 134 and pursue a pathto accommodate the incoming call. Specifically, from the block 134, ifno monitor is available, a monitor displaying a “green” display would ininterrupted. As indicated by a block 136, the “ANI” data from theincoming call would be employed to fetch the calling stationidentification and as indicated by the block 138, the DNIS data issimilarly fetched. With the identification and status data in hand, theoperation proceeds as represented by block 140 to display the compositescene and graphic data as depicted in FIG. 4.

The operation of input of the block 140 introduces a query as posed by ablock 142 regarding the nature of the call, i.e., “incoming” or“outgoing”. If the call was outgoing, as indicated by the block 142, itis automatically terminated after 30 seconds. Alternatively, if the callis “incoming”, the operation is yielded to manual control as indicatedby the block 146.

Returning now to the block 132 (FIG. 4, upper left), the circumstance of“no” “incoming” call advances the program to a query block 150 directedto the state of the current waiting list of lines with establishedcontact with a remote location. If the waiting list is full, or hasattained a predetermined limit, a “yes” is prompted. The operation thenreturns to the entry point of the line 130 to cycle the query posed bythe block 132.

Following the alternative “no” path from the block 150 indicating thewaiting list is not full advances the program to a block 152. Theresulting operation is to fetch the next “out” call telephone number andthe related data for the graphics display. As indicated above, in oneembodiment, the data is simply addressed in the memory 48 (FIG. 6) by afour-digit number uniquely designating each remote location.

With the available telephone number, the auto dialer 46 is actuated asindicated by the block 154 (FIG. 7) during the interval while thegraphics data is prepared for display. Exiting from the block 154, threeparallel, somewhat simultaneous queries, are presented by blocks 156,158 and 160. A “yes” response to any of the three queries prompts afresh course of action as now will be considered.

The query block 156 poses the query of an “incoming” call. If such acall occurs, the operation is terminated in favor of receiving thatcall. Thus, the system reverts to block 134.

The query block 158 poses the query of time, i.e., “Have twenty secondspassed on the clock?” (not shown) in the control computer 44 (FIG. 6).If that interval does pass prior to the time when the called telephoneis “answered” (goes “off-hook”), some difficulty is presumed. Under sucha circumstance, the system makes additional attempts to attain aconnection. If unsuccessful, other action is signaled, as by manualintervention.

Pursuing the course from the block 158 of FIG. 7, the calling connectionis terminated (block 157), a counter is advanced (block 159) and unlessthe counter is at capacity (query block 161) with some delay, the callis again placed. After a predetermined number of efforts, e.g., threecycles, the counter is filled to prompt an “operator alert” (block 163).As a result, with manual intervention, other action is suggested. Forexample, alternate telephone numbers may be tried by manualintervention.

Next, assume that the outgoing call is answered as indicated by theblock 160. The operation proceeds to the block 140 to accomplish theoperations attendant providing the display. In that regard, theoperation of the block 140 was considered above in relation to“incoming” calls. However, in the instant situation, involving an“outgoing” call, the operation proceeds to the block 144 simply toterminate the connection and the attendant display after 30 seconds. Asindicated above, the display is given to an available one of the monitorstations V1-Vn from the waiting list somewhat as collectivelyrepresented by the block 140.

Thus, the system accomplishes a sequence of displays representative ofthe remote locations L1-Ln. As indicated above, a single monitor stationmay be employed; however, in the disclosed embodiment, several monitorstations V1-Vn share the sequence accommodating interruption either formanually controlled “outgoing” calls or “incoming” calls.

Recapitulating, the above description has treated automatically-actuatedincoming calls, manually-actuated incoming calls,automatically-sequenced outgoing calls and manually-actuated outgoingcalls, all with respect to a central unit CU. Details of the centralunit CU have been treated and now a detailed exemplary structure for aremote location will be considered. Accordingly, reference will now bemade to FIG. 8.

The videophone cameras C1-C6 are indicated at the top of FIG. 8connected to a control computer and videophone processor 170 which mayinvolve a relatively simple control to coordinate switches and sensorswith respect to a memory 172 (right center), a telephone switch orinterface 174 (left center) and an auto dialer 176 (left upper). Apartfrom the control function, the processor 170 incorporates the elementsfor videophone processing, e.g., a video-CODEC chip set as mentionedabove. As indicated, such structures are readily available forvideophone operation. In conjunction with such structure, the computer170 drives a video display 178 (left) and an audio speaker or announcer180 (right).

The control and processor 170 is additionally connected to a series ofsensors and switches as indicated above. Correlating the structure toFIG. 2, the switches S1-S1 are represented by a single block designated182 (lower left). The manager switches S5-S7 are represented by a block184. The infrared sensor or switch S8 is represented by a block 186(right) and the doorway detector or switch S9 is represented by a block188. Additionally, a roving guard switch is represented by a block 190and an audio sensor or threshold microphone is designated by a block192. The situation status prompted by the switches can be seen in FIG.8, i.e., RGY (“red”, “green” and “yellow” conditions).

Generally, with regard to control, the processor 170 has a dual functionof responding to “incoming” calls and responding to local switches toplace “outgoing” calls. Note that with respect to the processor 170, thedesignations “incoming” and “outgoing” calls are reversed from theterminology as used above with respect to the central unit CU.

Upon the occurrence of an incoming call from the telephone system TSthrough a cable 195, the telephone interface unit 174 establishes aconnection through the processor 170 to the video display 178 andprompts the processor 170 to respond to processor control signals. Morespecifically, an incoming call prompts the control processor 170 tofetch a set of standard conditions from a look-up table embodied in thememory 172 to thereby establish settings for the videophone camerasC1-C6 and activate the video display 178 and the audio announcer 180.One of the cameras, typically camera C1, also will be selected.Accordingly, in response to the received call, the processor 170provides an output from the camera C1 (set with a wide field of vision)through the telephone interface 174 to be carried as a videophone signalembodying both video and audio data. Additionally, the video display 178and the audio announcer 180 are activated for response to any receivedaudio or video data.

As indicated above, various signals may be communicated from the centralunit CU through the telephone interface 174 to the control processor 170for varying the settings of the cameras C1-C6. Thus, both control andvideophone signals are communicated between the cameras C1-C6 and theprocessor 170. The videophone signals are provided through a series oflines Y1-Y6. The control signals pass in the other direction throughlines A1-A6 and camera control units CC1-CC6, respectively. Essentially,the control units CC1 and CC6 activate the cameras C1-C6 for panning andfield-of-vision changes. In that regard, the processor 170 simplydecodes data signals originated at the central unit CU to actuate thecontrol units CC1-CC6. Thus, once communication is established, thelocation apparatus of FIG. 8 simply responds to commands and any audioor video supplied. To initiate a communication the apparatus operates ina manner similar to the central unit CU.

With respect to outgoing calls, the processor 170 responds to various ofthe sensors or switches as embodied in the blocks 182, 184, 186, 188,190 and 192. The sensor or switch of each of the blocks is associatedwith a look-up table embodied in the memory 172 storing a telephonenumber for designating the status and a calling line for designating thelocation. That is, as explained in detail above, generally DNIS signalsare interpreted at the central unit to indicate a particular statuswhile ANI signals are employed to indicate the location of the callingfacility. An exemplary sequence will illustrate the operation.

Assume for example that a person enters the bank facility at location L1(FIG. 2) carrying a weapon. Further assume that the door sensor 59embodied in the detector 188 (FIG. 8) senses the presence of a sizeablemetallic object and provides a signal to the control processor 170.Based on the source of the signal, the control computer addresses thememory 172 to fetch the telephone number for the central unit CUestablished to indicate a “caution” or “yellow” situation. Thattelephone number is retrieved. Accordingly, the telephone interface 174goes “off-hook” and the auto dialer 176 is actuated to dial the fetchedtelephone number. Consequently, the telephone interface 174 is coupledfor communication through the cable 195 and the dial-up telephonefacility with the central unit CU. The ANI and DNIS signals provided,the camera C1 then provides audiovisual data for a videophone signalsupplied from the control processor 170 and the telephone interface 174to the active line. Accordingly, the desired display is accomplished asexplained above, also affording various selected control operations fromthe central unit CU, as indicated above.

To consider an exemplary control operation, assume for example that theoperator at the central unit CU perceives a particular problem at theteller window T1 (FIG. 2). As a consequence, an operation command wouldbe entered as described above switching the source of the videophonesignal from the camera C1 to the camera C3. Also, command operatingsignals could be provided to pan or vary the field of vision provided bythe camera. Thus, a desired display of the area of interest wouldfollow.

As will be apparent from the above, systems of the present invention maybe variously implemented to accommodate a multitude of differentfacilities and needs. Also, the system may be configured to accommodatespecialists at the videophone terminals V1-Vn (FIG. 1, 3 or 6). Forexample, certain of the terminals V1-Vn might be attended by specialistsin identified emergencies, e.g., situation “red” or “emergency” calls.Other terminals might be attended by specialists in “alert” or “yellow”situations, e.g., a suspicious man standing in a doorway, etc. Pursuingthe considerations, still other of the terminals V1-Vn could bemonitored by specialists in the standard or routine monitoring, e.g.,ten or twenty seconds per location.

To accommodate the dedication of certain terminals V1-Vn to specialists,the switch 102 (FIG. 6) is controlled by the control computer totransfer connected remote locations L1-Ln from one of the terminalsV1-Vn to another. In some instances, it also may be desirable to couplea location to several of the terminals.

Referring now to FIG. 9, in accordance with another exemplaryembodiment, multiple operators at multiple monitor stations V1-Vn areillustrated. As explained above, multiple central units CU may beemployed to monitor widely distributed locations with capabilities ofrouting calls to each other. At each of the central units CU, incomingcalls are sequenced to each of the operators at the each of the monitorstations depending on the cumulative handling capability of eachoperator. For example, if a particular operator is handling calls at theaverage rate of six seconds each, calls to that operator will besequenced at that rate. As described above, inbound calls are receivedthrough the telephonic interconnection 102 (FIG. 6, upper left)accommodated by the interface telephone switch 42 as well known in theart.

Incoming calls are queued by the call-waiting register 200, for examplea FIFO, and handed to the next available operator in sequence.Considering the placement of outgoing calls (under manual or automaticcontrol) to provide a sequential display from remote locations L1-Ln,autodialers 46 establish communication with each of the locations L1-Lnin sequence and forward the calls to the next available operator.

For most operating systems, it is likely that during much of the time,the monitor stations will collectively be programmed to automaticallyprovide a sequential display of the remote location L1-Ln. During thesequential operation, the control computer 44 or the calling scheduleprogram of the control computer 201 fetches telephone numbers for remotelocations L1-Ln from memory (FIG. 6) in sequence, actuates the autodialer 46 accordingly, and assigns the resulting connections to one ofthe monitor stations V1-Vn. Note that an ARU (audio response unit) 199is coupled between the switch 42 and the control computer 44 as tosupplement the operation using the established capabilities of suchunits.

After short intervals of operation, e.g. 30 seconds or 10 seconds, thecontrol computer 44 terminates the display connection to the stationV1-Vn in favor of another waiting connection at the call-waitingregister 200. The intervals of operation may vary depending upon therate at which the operator views the displays. The operator may manuallyrequest the next display by operating the control button 99 (FIG. 5, topcenter).

Alternatively, rate monitors R1-Rn connected to each of the monitorstations V1-Vn respectively monitor the cumulative handling capabilityof each operator, for example, count the number of calls handled by eachoperator in a given period of time. Based upon the count provided by therate monitors R1-Rn, the control computer 44 assigns a calling rateindex number for each operator. The number controls the volume of callsqueued for each operator. For example, CHART 4, sets forth exemplarycalling rate index as for various numbers of calls per minute. In theevent an operator is capable of handling 30 calls, his or her callingrate index in accordance with the exemplary chart would be 3 and so on.The calling rate index is indicated by a storage 204 (FIG. 9, right).

CHART 4 Calls Per Minute Calling Rate Index 30 3 35 4 40 5 45 6 50 7 558 and so on and so on

As a further consideration, if the cumulative handling capabilities ofthe operators decrease or increase, the rate monitor R1-Rn would reportsuch a change to the computer control 44 thereby altering the number ofcalls contemplated for the operators. In that regard, the operators maycontrol the speed control button 101 to vary the number of calls.Records of call schedules and performance are provided by a printer 205.

Furthermore, selective distribution of calls may be appropriate, forexample, as explained, calls reporting “emergency” situations may beforwarded to a particular operator trained in emergency procedures.Alternatively, calls may be routed to the next available operator. Inaddition, as the calls are queued in sequence, calls reporting“emergency” or “alert” situations may precede other routing calls inaccordance with an override feature. In keeping with this feature an“emergency” situation may automatically override an “alert” situation.

A logic program further indicating the control operations of the controlcomputer 44 according to an exemplary format will now be treated withreference to FIG. 10. The process is entered at a line 210 (top center)shown leading to a decision or query block 212. The query posed by thequery block 212 relates to whether the number of waiting calls exceedthe current index. In the sequence dial-up system, the logic preserves areadiness for receiving incoming calls. Should the number of waiting ofcalls exceed a predetermined current index, prompting a “yes”, the path214 from the block 212 proceeds to a block 216 for a delay. The delaymay be predetermined, after which the process returns along path 218 tothe query block 212 again posing the same question.

If it is determined that the number of waiting calls does not exceed thecurrent index, the process proceeds along path 220 to a block 222. Asindicated by block 222, data on the next location L1-Ln is fetched. Atthis point the program advances along line 224 to block 226, whereby anavailable auto dialer 46 is determined. Line 228 leads to block 230directed to actuating the auto dialer 46 to establish connection withone of the locations L1-Ln. One output path 232 from block 228 leads toa query block 234 and introduces a query as to whether there is ananswer from the location L1-Ln. If an answer from the location L1-Ln isreceived, the call-waiting register 200 is advanced by block 235.

Another output path 236 from block 228 leads to another query block 238to determine if twenty seconds have passed. Following a predeterminedtime period, if the autodialer 46 is unable to establish connection an“alert” situation is reported, as indicated by a block 240.

Pursuing an alternative logic process relating to incoming calls, a line244 (upper right) leads to a query block 246 to determine if a monitorstation V1-Vn is available. If all the monitor stations V1-Vn areoccupied, a line 248 from the query block delays the process at block250 and following a return line 252 again poses the query at block 246.

Assuming that a monitor station V1-Vn is available, as indicated byblock 260, the foremost (oldest) or first received call waiting isforwarded to the monitor station V1-Vn. The call-waiting register 200notes a decrement at block 262 and subsequently fetches a locationmonitor schedule from memory at the central unit CU indicated by block264.

As explained above, the location monitor schedule may specify a sequenceof view displays for each location, as in the event multiple cameras areinvolved. Using a previous example of FIG. 2, the location monitorschedule may define an initial panoramic view, followed by the view froma first camera for twenty seconds, followed by a view from a secondcamera for ten seconds, then zooming onto a vault that would appear inthe view from a third camera for ten seconds.

In relation to scheduled formats, as explained, the operation of block264 is to implement monitor schedules if specified. From the block 264,a line 266 advances the process to block 268, at which stage theoperator can actuate the status controls to sequence displays, forexample, in accordance with the location monitor schedule. At queryblock 270, a query is posed as to whether a video signal is receivedfrom the location L1-Ln. In the event no video is received, for example,if the camera lens has been deliberately covered or broken, operationreturns to block 268 along line 272, enabling the operator to actuatecontrols, for example, to display a view from the next camera to betterassess the situation in case of an emergency, etc. Alternatively, suchoperation may be automatic. After viewing of the location L1-Ln has beenperformed, the above process is repeated with the next incoming call.

FIG. 11 illustrates an exemplary storage cell of the central unit CUwherein the telephone number, graphic data and additionally, locationmonitor schedules may be stored. For example, the telephone number forlocation designated L417 is indicated at field 280, and other pertinentgraphics data is indicated at a field 282. A binary number field Dindicates the display format. A “0” specifies that only a panoramic viewis desired, for example as for a convenience store. A binary number “1”,on the other hand denotes a more sophisticated location monitorschedule. Additionally, the location monitor schedule is stored, asindicated at field 286, outlining the exact sequence to be followed. Itshould be recognized that location monitor schedules may be revised andupdated on site at central units CU as well as from remote locations.For example, considering a large bank with 1000 branch offices whereeach branch office is routinely monitored by five installed cameras fora twenty second time interval every hour on a daily basis, changes,cancellations or updates to monitor schedules between branches may berequested remotely.

In accordance with a format for conducting market research, a singlemonitor V1 may be used to monitor the desired location, for example abank for determining customers' reaction to new interest rates. As anexample, zoom in capabilities of the camera C2 may be utilized to viewand listen to a bank teller's interaction with a customer. At thecentral unit CU, a recording of the interaction or the researcher'sobservations may be obtained by entering data via the keyboard andstoring the data in memory. The researcher may request subsequentlocations via the push button 99. By depressing the push button, theauto dialer 46 automatically dials the next location. The auto dialer 46may have all the respective telephone numbers of all the locationsstored in memory. Alternately, calls may be queued for automaticswitching of locations after predetermined time periods controlled by aclock, for example five minutes.

In a simple monitoring or “video escort” format to ensure properexecution, deposit, withdrawal and the like, of funds at banks orsupermarkets may involve monitoring at select times of the day forpredetermined time periods. For example, supermarkets at remotelocations may be called up and daily closing procedures involvingsecuring of monetary funds, etc. may be observed (e.g. 9:55-10:00 p.m.,every evening). In a related format, inspections of restaurantfacilities and like may be conducted from one of the central units CU.

In a related context, a branch manager may contact the central units CUfrom an external telephone (regular or cellular) and request a videoescort prior to entering the branch facility. Accordingly, the branchmanagers are monitored by the central unit CU1-N as they conduct theirbusiness, for example, handle large funds etc. Signals (ANI or DNIS)identifying telephone numbers may be employed to implement a desireddisplay at the central units CU1-N.

In view of the above description, it will be apparent that numerousoperating formats, programs and layouts may be accomplished using a widevariety of videophone equipment in cooperation with computing and sensorapparatus. As indicated above, the disclosed embodiment affords onearrangement; however, the scope hereof should not so confined, ratherthe scope hereof should be in accordance with the claims as set forthbelow.

1. A system for communicating with a plurality of remote locations froma central station utilizing telephonic communication facilitiescomprising: video communication structures located at the plurality ofremote locations for providing representative image signals of scenes atthe plurality of remote locations and for receiving and sending audiosignals to carry voice over the telephonic communication facilities; aplurality of video display structures, including audio capability,located at the central station for receiving and displaying therepresentative image video signals of the plurality of remote locations;telephonic interface apparatus for interconnecting the videocommunication structures at the plurality of the remote locations withthe plurality of the video display structures at the central station andincluding two way audio communication capability at the central station;and a control unit for controlling the telephonic interface apparatus toestablish video and audio communication between a select video camerastructure at a select one of the plurality of remote locations and oneof the plurality of video display structures at the central station,with the central station receiving a display of a scene from the selectone of the plurality of remote locations and the same select one of theplurality of remote locations receiving audio communication from thecentral station via the telephonic interface apparatus.